(19) 



3 



(12) 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets (11) EP 1 052 598 A2 

EUROPEAN PATENT APPLICATION 



(43) Date of publication: 

15.11.2000 Bulletin 2000/46 

(21) Application number: 00109179.2 

(22) Date of filing: 08.05.2000 



(51) intci. 7 : G06T3/40, H04Q7/32, 
H04M 11/00, H04Q7/14, 
H04L 12/66 



(84) Designated Contracting States: 

AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 
MC NL PT SE 

Designated Extension States: 
AL LT LV MK RO SI 

(30) Priority: 13.05.1999 JP 13225199 

(71) Applicant: 

MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD. 
Kadoma-shi, Osaka-fu, 571 (JP) 

(72) Inventors: 

• Shin, Hidehiko 
Moriguchi-schi, Osaka-fu (JP) 



• Wada, Hiromi 
Neyagawa-shi, Osaka-fu (JP) 

• Yoshida, Naoya 
Kyotanabe-shi, Kyoto-fu (JP) 

• Kato, Atsunobu 
Ebina-shi, Kanagawa-ken (JP) 

(74) Representative: 

Lang, Johannes, Dipl.-lng. et al 

Bardehle Pagenberg Dost Altenburg Geissler 

Isenbruck, 

Postfach 86 06 20 

81633 Munchen (DE) 



(54) Information terminal device with a resizing unit for images and selection unit for a 
background image 



(57) A mobile terminal (10) is provided which can 
obtain an image from a server (1 8) and change the size 
of the image so as to use the image as a background 
image. An image obtaining unit (407) obtains an image 
from a server. An over-size decision unit (410) decides 
whether the entirety of the image obtained by the image 
obtaining unit can be displayed within the display area in 



a screen. When the over-size decision unit provides a 
negative decision, an image resizing unit (41 1 ) changes 
the size of the image obtained by the image obtaining 
unit so that it can be displayed within the display area 
(504) in the screen. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to information 
terminal devices, and more particularly to small-sized 
information terminals such as mobile terminals, typi- 
cally, mobile telephones, or portable information termi- 
nals which have a function of obtaining documents or 
images from servers through the Internet. 

Description of the Background Art 

[0002] The recent remarkable advances in informa- 
tion technology are now allowing users to instantane- 
ously obtain various information through the Internet 
just by entering addresses into personal computers to 
access to desired locations. The information obtained 
includes hypertexts in HTML (HyperText Mark-up Lan- 
guage) and mails described in MIME (Multipurpose 
Internet Mail Extensions), for example. A user can 
request acquisition of information from a server or dis- 
play the information obtained from the server on the 
screen by using a hypertext display device in which an 
application called browser is installed or a mail display 
device in which an application called mailer is installed. 
[0003] Netscape Navigator and Internet Explorer 
are examples of widespread browsers. Such browsers 
can obtain image information (images) from a server 
through the Internet, and such images can be utilized as 
the background (background image) or a screen saver. 
[0004] The recent developments of downsized 
equipment are presenting small-sized information termi- 
nals such as mobile telephones, portable information 
terminals, etc. in which a browser or a mailer is 
installed. Now the users are demanding that such small- 
sized information terminal devices should be equipped 
for the function of obtaining an image from a server and 
setting it as the background image etc., as is possible in 
personal computers. 

[0005] When a user uses an image obtained from a 
server as a background image in a personal computer, 
it is possible to accumulatively store a plurality of 
images and select and use one of the images as the 
background image. Accordingly, users will also demand 
that such small-sized information terminal devices, too, 
be equipped with the function of selecting an image, as 
in the personal computers, in the operation of utilizing 
an image obtained from a server as the background 
image. 

(First Problem) 

[0006] In contrast with personal computers, such 
small-sized information terminal devices have smaller 
display screens, and different models of small-sized 



information terminal devices have display screens of dif- 
ferent sizes. Therefore utilizing an image obtained from 
a sever as a background image requires resizing to 
adjust the image to the display screen. 
5 [0007] However, existing browsers are designed to 
be used in personal computers whose screen size is 
fixed, so they do not have the function of changing the 
size of an image before setting it as the background 
image. 

10 [0008] Accordingly, conventional small-sized porta- 
ble information terminals cannot use an image obtained 
from a sever as a background image. 
[0009] It is possible to change the size of an image 
obtained from a server by using an image processing 

15 tool etc. and set it as the background image. However, 
this method is possible only for information terminal 
devices which have relatively large storage capacity and 
have a pointing device etc. for easy entering operation. 
Particularly, the method using an image processing tool 

20 is not practical for mobile telephones, since their stor- 
age capacity is severely limited and the entering opera- 
tion would require extremely complicated operation 
using ten-keys and buttons. 

25 (Second Problem) 

[0010] Information terminal devices having no 
pointing device, particularly mobile telephones, cannot 
allow the users to easily select a desired image from 

30 among a plurality of images obtained from servers. 

[001 1] The following method is suggested to select 
a desired image from a plurality of images in an informa- 
tion terminal device having no pointing device, for exam- 
ple. That is to say, a user operates keys to specify one 

35 name among names of a plurality of images displayed 
on the screen to select the image corresponding to that 
name. This method requires the processing of generat- 
ing names of the images, but this processing is not easy 
for the information terminal devices since any image is 

40 just a group of pixel data for the devices. 

SUMMARY OF THE INVENTION 

[001 2] Therefore, a first object of the present inven- 
45 tion is to provide an information terminal device which 
can obtain an image from a server and change the size 
of the image so that it can be used as the background 
image. 

[0013] A second object of the present invention is to 
so provide an information terminal device which can obtain 
and store images from a server and select and display 
an image that a user desires among the plurality of 
images stored. 

[0014] The present invention has the following fea- 
55 tures to solve the problems explained above. 

[0015] A first aspect of the invention is directed to 
an information terminal device which obtains an image 
from a server and displays the image in a display area 
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of a screen, the information terminal device comprising: 

an obtaining unit operable to obtain the image from 
the server; 

an over-size decision unit operable to decide 
whether the entirety of the image obtained by the 
obtaining unit can be displayed within the display 
area of the screen; and 

a resizing unit operable to, when the over-size deci- 
sion unit makes a negative decision, change the 
size of the image obtained by the obtaining unit so 
that the image can be displayed within the display 
area of the screen. 

[0016] In accordance with the first aspect above, it 
is possible to obtain an image from a server and change 
the size of the image to use it as the background image. 
[0017] According to a second aspect, in the first 
aspect, the over-size decision unit detects the size of 
the image obtained by the obtaining unit and compares 
the size of the image with the size of the display area of 
the screen to decide whether the entirety of the image 
can be displayed within the display area of the screen. 
[0018] In accordance with the second aspect 
above, it is possible to decide whether the image 
extends past the display area of the screen. 
[0019] According to a third aspect, in the first 
aspect, the display area of the screen is variable in size, 
and 

the over-size decision unit detects the size of the 
image obtained by the obtaining unit and the size of 
the display area of the screen and compares the 
two sizes with each other to decide whether the 
.entirety of the image can be displayed within the 
display area of the screen. 

[0020] In accordance with the third aspect above, it 
is possible to decide whether the image exceeds the 
size limit of the display area of the screen even when 
the display area of the screen is variable in size. 
[0021] According to a fourth aspect, in the third 
aspect, 

the over-size decision unit notifies the resizing unit 
of the detected two sizes, and 

the resizing unit calculates an enlarging/shrinking 
ratio on the basis of the two sizes notified by the 
over-size decision unit and changes the size of the 
image obtained by the obtaining unit by enlarg- 
ing/shrinking the image at the enlarging/shrinking 
ratio. 

[0022] In accordance with the fourth aspect above, 
an enlarging/shrinking ratio is obtained from the size of 
the image and the size of the display area of the screen 
and the size of the image is changed by enlarg- 
ing/shrinking the image at that ratio. Preferably, the 



enlarging/shrinking ratio is such a value that the size of 
the resized image coincides with the size of the display 
area of the screen, which is obtained by dividing the 
size of the display area of the screen by the size of the 
5 image. 

[0023] According to a fifth aspect, in the first aspect, 

the display area of the screen is variable in size, 
and 

10 the over-size decision unit detects the lateral size 
and the longitudinal size of the image obtained by 
the obtaining unit and the lateral size and the longi- 
tudinal size of the display area of the screen and 
compares the two lateral sizes with each other and 

is the two longitudinal sizes with each other to decide 
whether the entirety of the image can be displayed 
within the display area of the screen individually in 
the lateral direction and in the longitudinal direction. 

20 [0024] In accordance with the fifth aspect above, it 
is possible to decide whether the image extends past 
the display area of the screen in the lateral direction and 
the longitudinal direction even if the display area of the 
screen is variable in size. 

25 [0025] According to a sixth aspect, in the fifth 
aspect, 

the over-size decision unit notifies the resizing unit 
of the detected two longitudinal sizes and the two 

30 lateral sizes, and 

the resizing unit calculates an enlarging/shrinking 
ratio in the lateral direction on the basis of the two 
lateral sizes notified by the over-size decision unit 
and calculates an enlarging/shrinking ratio in the 

35 longitudinal direction on the basis of the two longi- 
tudinal sizes, and changes the size of the image 
obtained by the obtaining unit by enlarging/shrink- 
ing the image in the lateral direction and in the lon- 
gitudinal direction at a smaller one of the two 

40 enlarging/shrinking ratios. 

[0026] In accordance with the sixth aspect above, 
an enlarging/shrinking ratio in the lateral direction is 
obtained from the lateral size of the image and the lat- 

45 eral size of the display area of the screen, and an 
enlarging/shrinking ratio in the longitudinal direction is 
obtained from the longitudinal size of the image and the 
longitudinal size of the display area of the screen, and 
the size of the image is changed by enlarging/shrinking 

so the image at a smaller one of the two enlarging/shrink- 
ing ratios in the longitudinal and lateral directions. In this 
case, since the image is enlarged/shrunk at the same 
ratio in the longitudinal and lateral directions, the image 
is not compressed in shape after resized. 

55 [0027] According to a seventh aspect, in the fifth 
aspect, 

the over-size decision unit notifies the resizing unit 
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of the detected two longitudinal sizes and the two 
lateral sizes, and 

the resizing unit calculates an enlarging/shrinking 
ratio in the lateral direction on the basis of the two 
lateral sizes notified by the over-size decision unit 
and calculates an enlarging/shrinking ratio in the 
longitudinal direction on the basis of the two longi- 
tudinal sizes, and changes the size of the image 
obtained by the obtaining unit by enlarging/shrink- 
ing the image in the lateral direction and in the lon- 
gitudinal direction at the respective 
enlarging/shrinking ratios. 

[0028] In accordance with the seventh aspect, an 
enlarging/shrinking ratio in the lateral direction is 
obtained from the lateral size of the image and the lat- 
eral size of the display area of the screen, and an 
enlarging/shrinking ratio in the longitudinal direction is 
obtained from the longitudinal size of the image and the 
longitudinal size of the display area of the screen, and 
the size of the image is changed by enlarging/shrinking 
the image in the longitudinal direction and in the lateral 
direction at the respective enlarging/shrinking ratios. In 
this case, since the image is enlarged/shrunk in the lon- 
gitudinal and lateral directions at separate ratios, the 
size of the resized image coincides with the size of the 
display area of the screen both in the longitudinal and 
lateral directions. 

[0029] According to an eighth aspect, in the fifth 
aspect, 

the information terminal device further comprises a 
form setting unit operable to set any of a first resiz- 
ing form for changing the size by enlarging/shrink- 
ing the image in the lateral direction and the 
longitudinal direction at the same enlarging/shrink- 
ing ratio, a second resizing form for changing the 
size by removing part of the image, and a third 
resizing form for changing the size by enlarg- 
ing/shrinking the image in the lateral direction and 
the longitudinal direction at separate enlarg- 
ing/shrinking ratios, and 

the resizing unit changes the size of the image 
obtained by the obtaining unit by using the form set 
by the form setting unit. 

[0030] In accordance with the eighth aspect above, 
the first to third resizing forms having their respective 
advantages can be selected to realize resizing suited to 
the features of the image or resizing suited to the pref- 
erence of a user. 

[0031] According to a ninth aspect, in the first 
aspect, the resizing unit changes the size by removing 
part of the image obtained by the obtaining unit. 
[0032] In accordance with the ninth aspect above, 
part of an image is removed to change its size. In this 
case, the resolution of the image is kept unchanged 
after the size is changed. 



[0033] A tenth aspect is directed to an information 
terminal device which obtains and stores images from a 
server and displays any of the plurality of stored images, 
the information terminal device comprising: 

5 

an obtaining unit for obtaining from the server the 
images and a document which contains image 
information associated with the images and allow- 
ing a user to identify the images; 
10 an image accumulative storage unit operable to 
accumulatively store the images obtained by the 
obtaining unit; 

an image information extracting unit operable to 
extract the image information from the document 
is obtained by the obtaining unit; 

a list generating unit operable to generate a list 
composed of a plurality of pieces of the image infor- 
mation extracted by the image information extract- 
ing unit; 

20 a list display unit operable to display the list gener- 

ated by the list generating unit; 
a selecting unit operable to select a piece of the 
image information specified by a user from among 
the plurality of pieces of image information con- 

25 tained in the list displayed by the list display unit in 
accordance with an instruction from the user; and 
an image display unit operable to obtain the image 
associated with the image information selected by 
the selecting unit from the image accumulative stor- 

30 age unit and displaying the image. 

[0034] In accordance with the tenth aspect above, it 
is possible to obtain images from a server, store the 
images, select an image the user desires from among 

35 the plurality of images stored, and display the image. 
[0035] According to an eleventh aspect, in the tenth 
aspect, when the image associated with the image 
information selected by the selecting unit is absent in 
the image accumulative storage unit, the image_display 

40 unit requests the obtaining unit to obtain the image from 
the server. 

[0036] In accordance with the eleventh aspect 
above, when the image associated with the selected 
image information is not accumulatively stored, that 
45 image is obtained from a server. 

[0037] According to a twelfth aspect, in the tenth 
aspect, 

the server is a WWW server connected to the Inter- 
50 net, 

the image information is the storage location of the 
image, and 

the document which contains the image information 
is an HTML document 

55 

[0038] In accordance with the twelfth aspect, while 
the information terminal device obtains an HTML docu- 
ment and images from a WWW serverthrough the Inter- 
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net and accumulatively stores the images, it also 
extracts the storage locations (e.g. "moon, gif ) of the 
images from the HTML document. Since the storage 
location of an image is associated with the image and 
usually contains the name of the image, the user can 5 
easily know what kind of image it is. 
[0039] A thirteenth aspect is directed to an image 
resize and display method performed by an information 
terminal device to obtain an image from a server and 
display the image in a display area of a screen, the w 
image resize and display method comprising: 

an obtaining step of obtaining the image from the 
server; 

an over-size decision step of deciding whether the 75 
entirety of the image obtained in the obtaining step 
can be displayed within the display area of the 
screen; and 

a resizing step of, when the over-size decision step 
makes a negative decision, changing the size of the 20 
image obtained in the obtaining step so that the 
image can be displayed within the display area of 
the screen. 

[0040] According to a fourteenth aspect, in the thir- 25 
teenth aspect, the over-size decision step detects the 
size of the image obtained in the obtaining step and 
compares that size with the size of the display area of 
the screen to decide whether the entirety of the image 
can be displayed within the display area of the screen. 30 
[0041] According to a fifteenth aspect, in the thir- 
teenth aspect, 

the.display area of the screen is variable in size, 
and 35 
the over-size decision step detects the size of the 
image obtained in the obtaining step and the size of 
the display area of the screen and compares the 
two sizes with each other to decide whether the 
entirety of the image can be displayed within the 40 
display area of the screen. 

[0042] According to a sixteenth aspect, in the fif- 
teenth aspect, the resizing step calculates an enlarg- 
ing/shrinking ratio on the basis of the two sizes detected 45 
in the over-size decision step and changes the size of 
the image obtained in the obtaining step by enlarg- 
ing/shrinking the image at the enlarging/shrinking ratio. 
[0043] According to a seventeenth aspect, in the 
thirteenth aspect, 50 

the display area of the screen is variable in size, 
and 

the over-size decision step detects the lateral size 
and the longitudinal size of the image obtained in 55 
the obtaining step and the lateral size and the longi- 
tudinal size of the display area of the screen and 
compares the two lateral sizes with each other and 



the two longitudinal sizes with each other to decide 
whether the entirety of the image can be displayed 
within the display area of the screen individually in 
the lateral direction and in the longitudinal direction. 

[0044] According to an eighteenth aspect, in the 
seventeenth aspect, the resizing step calculates an 
enlarging/shrinking ratio in the lateral direction on the 
basis of the two lateral sizes detected in the over-size 
decision, step and calculates an enlarging/shrinking 
ratio in the longitudinal direction on the basis of the two 
longitudinal sizes, and changes the size of the image 
obtained in the obtaining step by enlarging/shrinking the 
image in the lateral direction and in the longitudinal 
direction at a smaller one of the two enlarging/shrinking 
ratios. 

[0045] According to a nineteenth aspect, in the sev- 
enteenth aspect, the resizing step calculates an enlarg- 
ing/shrinking ratio in the lateral direction on the basis of 
the two lateral sizes detected in the over-size decision 
step and calculates an enlarging/shrinking ratio in the 
longitudinal direction on the basis of the two longitudinal 
sizes, and changes the size of the image obtained in the 
obtaining step by enlarging/shrinking the image in the 
lateral direction and in the longitudinal direction at the 
respective enlarging/shrinking ratios. 
[0046] According to a twentieth aspect, in the sev- 
enteenth aspect, 

the image resize and display method further com- 
prises a form setting step of setting any of a first 
resizing form for changing the size by enlarg- 
ing/shrinking the image in the lateral direction and 
the longitudinal direction at the same enlarg- 
ing/shrinking ratio, a second resizing form for 
changing the size by removing part of the image, 
and a third resizing form for changing the size by 
enlarging/shrinking the image in the lateral direction 
and the longitudinal direction at separate enlarg- 
ing/shrinking ratios, and 

the resizing step changes the size of the image 
obtained in the obtaining step by using the form set 
in the form setting step. 

[0047] According to a twenty-first aspect, in the thir- 
teenth aspect, the resizing step changes the size by 
removing part of the image obtained in the obtaining 
step. 

[0048] A twenty-second aspect is directed to an 
image select and display method performed by an infor- 
mation terminal device to obtain images from a server, 
store the images, and select and display any of the plu- 
rality of stored images, the image select and display 
method comprising: 

an obtaining step of obtaining from the server the 
images and a document which contains image 
information associated with the images and allow- 
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ing a user to identify the image; 
an image accumulative storage step of accumula- 
tively storing the images obtained in the obtaining 
step; 

an image information extracting step of extracting s 
the image information from the document obtained 
in the obtaining step; 

a list generating step of generating a list composed 
of a plurality of pieces of the image information 
extracted in the image information extracting step; 1 o 
a list display step of displaying the list generated in 
the list generating step; 

a selecting step of selecting a piece of the image 
information specified by a user from among the plu- 
rality of pieces of image information contained in is 
the list displayed in the list display step in accord- 
ance with an instruction from the user; and 
an image display step of displaying the image asso- 
ciated with the image information selected in the 
selecting step among the images accumulatively 20 
stored in the image accumulative storage step. 

[0049] According to a twenty-third aspect, in the 
twenty-second aspect, when the image associated with 
the image information selected in the selecting step is 25 
absent among the images accumulatively stored in the 
image accumulative storage step, the image display 
step obtains the image from the server and displays the 
image. 

[0050] According to a twenty -fourth aspect, in the 30 
twenty-second aspect, 

the server is a WWW server connected to the Inter- 
net, 

the image information is the storage location of the 35 
image, and 

the document which contains the image information 
is an HTML document. 

[0051] A twenty-fifth aspect is directed to a storage 40 
medium which contains a program for causing an infor- 
mation terminal device to perform an image resize and 
display method for obtaining an image from a server 
and displaying the image in a display area of a screen, 
the image resize and display method comprising: 45 

an obtaining step of obtaining the image from the 
server; 

an over-size decision step of deciding whether the 
entirety of the image obtained in the obtaining step so 
can be displayed within the display area of the 
screen; and 

a resizing step of, when the over-size decision step 
makes a negative decision, changing the size of the 
image obtained in the obtaining step so that the 55 
image can be displayed within the display area of 
the screen. 



[0052] A twenty-sixth aspect is directed to a storage 
medium which stores a program for causing an informa- 
tion terminal device to perform an image select and dis- 
play method for obtaining images from a server, storing 
the images, and selecting and displaying any of the plu- 
rality of stored images, the image select and display 
method comprising: 

an obtaining step of obtaining from the server the 
images and a document which contains image 
information associated with the images and allow- 
ing a user to identify the images; 
an image accumulative storage step of accumula- 
tively storing the images obtained in the obtaining 
step; 

an image information extracting step of extracting 
the image information from the document obtained 
in the obtaining step; 

a list generating step of generating a list composed 
of a plurality of pieces of the image information 
extracted in the image information extracting step; 
a list display step of displaying the list generated in 
the list generating step; 

a selecting step of selecting a piece of the image 
information specified by a user from among the plu- 
rality of pieces of image information contained in 
the list displayed in the list display step in accord- 
ance with an instruction from the user; and 
an image display step of displaying the image asso- 
ciated with the image information selected in the 
selecting step among the images accumulatively 
stored in the image accumulative storage step. 

[0053] These and other objects, features, aspects 
and advantages of the present invention will become 
more apparent from the following detailed description of 
the present invention when taken in conjunction with the 
accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0054] 

FIG. 1 is a block diagram showing the configuration 
of a mobile communication system which is an 
example of an application of the present invention. 
FIG. 2 is a block diagram showing an example of the 
structure of the terminal 10 shown in FIG.1. 
FIG. 3 is a block diagram showing an example of the 
structure of the communication application unit 30 
shown in FIG.2. 

FIG. 4 is a block diagram showing the functional 
structure of the terminal of the first embodiment of 
the invention. 

FIG. 5 is a diagram showing an example of the 
structure of a screen in which the display 413 of 
FIG. 4 presents a display. 

FIG. 6 is a flowchart showing the operation in which 
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the terminal shown in FIG. 4 obtains an image from 
the WWW servers 18 and 19, changes the size of 
the image, and displays the image as the back- 
ground image in the effective display area 504 
shown in FIG.5. 5 
FIG.7A is a diagram visually showing a first image 
resizing form (an example in which the image 
extends past the lateral limits of the effective display 
area). 

FIG .78 is a diagram visually showing the first image io 
resizing form (an example in which the image 
extends past the longitudinal limits of the effective 
display area). 

FIG.7C is a diagram visually showing the first 
image resizing form (an example in which the is 
image extends past the lateral and longitudinal lim- 
its of the effective display area). 
FIG.8A is a diagram visually showing a second 
image resizing form (an example in which the 
image extends past the lateral limits of the effective 20 
display area). 

FIG.8B is a diagram visually showing the second 
image resizing form (an example in which the 
image extends past the longitudinal limits of the 
effective display area). 25 
FIG.8C is a diagram visually showing the second 
image resizing form (an example in which the 
image extends past the lateral and longitudinal lim- 
its of the effective display area) 

FIG.9A is a diagram visually showing a third image 30 
resizing form (an example in which the image 
extends past the lateral limits of the effective display 
area). 

FIG.9B is a diagram visually showing the third 
image resizing form (an example in which the 35 
image extends past the longitudinal limits of the 
effective display area). 

FIG.9C is a diagram visually showing the third 
image resizing form (an example in which the 
image extends past the lateral and longitudinal Mm- 40 
its of the effective display area). 
FIG. 10 is a block diagram showing the functional 
structure of a terminal according to a second 
embodiment of the invention. 

F1G.1 1 is a schematic diagram showing an example 45 
of the structure of the display area 1101 in the 
screen of the display 1013 of FIG. 10 and the key- 
board of the input unit 1 001 . 

FIG. 12 is a flowchart showing a series of operation 
by the terminal shown in FIG. 10 from analyzing an 50 
HTML document for selecting and displaying an 
image as a background image. 
FIG. 13 is a diagram showing an example of the 
HTML document that the HTML accumulative stor- 
age unit 1006 stores in step S207 of FIG. 12. 55 
FIG. 14 is a flowchart showing the details of the 
HTML document analyzing processing in step S208 
of FIG. 12. 



FIG. 15 is a diagram showing an example of the 
HTML element information accumulatively stored in 
the HTML element information accumulative stor- 
age unit 1008 of FIG. 10 (which is the information 
obtained by analyzing the HTML document shown 
in FIG. 13). 

FIG. 16 is a diagram showing an example of the 
information list box that the display 1 01 3 displays in 
step S214 (an example in which the storage loca- 
tions of the entities of the images are described in 
characters). 

FIG. 17 is a diagram showing another example of 
the information list box that the display 1013 dis- 
plays in step S21 4 (an example in which the images 
themselves are shown). 

FIG. 18 is a block diagram showing the structure of 
the information selecting unit 1014 of FIG. 10. 
FIG. 19 is a diagram showing a focus applied to a 
box in the information list box (the window frame 
1901 applied to the box 1602 corresponds to the 
focus). 

FIG. 20 is a flowchart showing the details of the 
selecting processing in step S216 of FIG. 12. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

[0055] Embodiments of the present invention will 
now be described in detail referring to the drawings. 
[0056] First, a mobile communication system to 
which the present invention is applied will be described. 
[0057] FIG.1 is a block diagram showing the config- 
uration of a mobile communication system as an exam- 
ple of an application of the invention. In FIG.1, the 
mobile communication system includes a GW (gate- 
way) server 16 connected to the Internet 17, a plurality 
of WWW servers also connected to the Internet 17 
(which are represented by WWW servers 18 and 19 
here), a switching unit 15 connected to the GW server 
1 6, a plurality of base stations connected to and control- 
led by the exchange unit 15 (which are represented by 
base stations 12 to 14 here), radio zones controlled by 
the base stations (which are represented by the radio 
zone 20 controlled by the base station 12 here), and 
mobile terminals located in any of the radio zones 
(which are represented by the mobile terminals 1 0 and 
1 1 located in the radio zone 20 here). 
[0058] The WWW servers 18 and 19 store HTML 
documents described in hypertext such as HTML, 
images, etc. The terminals 10 and 11 can request 
acquisition of information from the WWW servers 18 
and 19 to obtain information held in the WWW servers 
18 and 19 through the Internet 17 and display the infor- 
mation by using display screens on the terminals 1 0 and 
11. For the communication between the base station 12 
and the terminals 1 0 and 1 1 in the radio zone 20, a dig- 
ital communication system using CDMA is used, for 
example. 
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[0059] FIG. 2 is a block diagram showing an exam- 
ple of the structure of the terminal 10shown in FIG.1. In 
FIG.2, the terminal 10 has an antenna 21, a radio con- 
troller 22, a modulator 23, a demodulator 24, a channel 
CODEC 25, a speech input unit 26, a speech output unit 
27, an input unit 28, a display 29, and a communication 
application unit 30. 

[0060] The radio controller 22 has the function of 
receiving modulated data from the modulator 23 and 
transmitting the data on a radio carrier from the antenna 
21 and the function of receiving a signal in a given fre- 
quency band from among high-frequency signals 
induced on the antenna 21. The modulator 23 modu- 
lates transmission data outputted from the channel 
CODEC 25 by a given system (e.g. n/4 shift DQPSK 
modulation) and outputs it to the radio controller 22. The 
demodulator 24 demodulates the signal received from 
the radio controller 22 and supplies it to the channel 
CODEC 25. The channel CODEC 25 distributes the 
input data from the demodulator 24 to the speech output 
unit 27 and the communication application unit 30. It 
also distributes speech input from the speech input unit 
26 to the modulator 23 and the communication applica- 
tion unit 30. Further, it distributes data input from the 
communication application unit 30 to the modulator 23 
and the speech output unit 27. 

[0061] The input unit 28 is composed of a keyboard 
or buttons, for example, which processes entry of dial 
numbers, display screen manipulating data, etc. The 
display 29 is composed of a display device etc., which 
screen-displays or vibration-outputs data outputted 
from the communication application unit 30, for exam- 
ple. The communication application unit 30 includes a 
CPU 31, RAM 32, ROM 33, VRAM 34, etc., which con- 
trols connection of communications and processing of 
transmission/received data, such as generation of 
transmission data, display and storage of received data, 
etc. in the terminal 10. 

[0062] FIG.3 is a block diagram showing an exam- 
ple of the structure of the communication application 
unit 30 shown in FIG.2. In FIG. 3, the communication 
application unit 30 includes an input controller 101, a 
speech controller 1 02, a display controller 103, an appli- 
cation controller 104, a browser application 105, a mail 
application 106, a telephony application 107, and a 
communication controller 108. 

[0063] The input controller 101 notifies the applica- 
tion controller 104 of the input key information etc. 
received from the input unit 28. The speech controller 
1 02 controls the posting of the speech received from the 
speech input unit 26 to the application controller 104 
and the output of the speech sent from the application 
controller 104 to the channel CODEC 25. The display 
controller 1 03 controls the output of display information 
notified by the application controller 104 to the display 
29. The application controller 104 controls switching 
between the plurality of applications installed in the ter- 
minal 10 and the distribution of information between the 



applications and the input controller 101, speech con- 
troller 102 and display controller 103. 
[0064] It is assumed here that three applications 
are installed in the terminal 10: the browser application 

5 105, mail application 106 and telephony application 
107. However, needless to say, the applications 
installed are not limited to these three applications. 
[0065] The plurality of applications installed in the 
terminal 10 can be classified into speech service appli- 

10 cations and character service applications. The speech 
service application supports only speech without per- 
forming transmission/reception of character data, image 
data, etc. The character service application performs 
transmission/reception of character data, image data, 

15 etc. and supports image display of information to be 
transmitted/received. For example, the browser applica- 
tion 105 and the mail application 105 are character 
service applications and the telephony application 107 
is a speech service application. 

20 [0066] The communication controller 108 controls 
connection of calls to be made or received, data com- 
munication, etc. in accordance with instructions from 
the applications (1 05 to 1 07). 

[0067] In the first embodiment described below, a 
25 program for allowing the terminal 10 to execute an 
image resize and display method of the invention is 
implemented in the browser application 105 installed in 
the terminal 10. In the communication application unit 
30, the communication controller 108 provides control 
30 according to instructions from the browser application 
105 which contains this program, whereby the terminal 
1 0 can perform the image resize and display processing 
which will be explained later. 

[0068] In a second embodiment, a program for 
35 allowing the terminal 1 0 to execute an image select and 
display method of the invention is implemented in the 
browser application 105 installed in the terminal 10. In 
the communication application unit 30, the communica- 
tion controller 1 08 provides control according to instruc- 
40 tions from the browser application 105 which contains 
this program, whereby the terminal 1 0 can perform the 
image select and display processing which will be 
described later. 

[0069] Now, the following three methods are sug- 
45 gested as methods for implementing the above-men- 
tioned programs in the browser application 105 
provided in the terminal 10. In a first method, the pro- 
grams are previously implemented in the browser appli- 
cation 105 before shipment of the terminal 10. In a 
so second method, the programs are supplied to the termi- 
nal 10 through a network like the Internet 17, a mobile 
communication network, etc. and implemented in the 
browser application. In a third method, the programs are 
presented to the user in a form stored in a portable 
55 recording medium like a CD-ROM and the user reads 
the programs from the portable recording medium using 
a personal computer etc. and transfers them to the ter- 
minal 10 to implement them in the browser application. 
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The second and third methods require that another pro- 
gram for allowing the terminal 1 0 to perform the imple- 
menting processing should be attached to each 
program. 

[0070] The description herein shows an example in 
which the programs are implemented in the browser 
application 105. However, needless to say, the pro- 
grams may be implemented in other application pro- 
vided in the terminal 10, or a new application dedicated 
to the programs may be provided in the terminal 1 0. 

(First Embodiment) 

[0071] FIG. 4 is a block diagram showing the func- 
tional structure of a terminal according to a first embod- 
iment of the invention. The terminal shown in FIG.4 
corresponds to the terminals 10 and 1 1 shown in FIG.1. 
Its hardware structure is shown in F1G.2 and the soft- 
ware structure of the communication application unit 30 
of FIG. 2 is shown in FIG.3. 

[0072] FIG. 5 is a diagram showing an example of 
the structure of a screen on which the display 413 of 
FIG.4 presents a display. In FIG. 5, the screen has a dis- 
play area 501 where an image can be displayed, which 
is composed of an effective display area and an ineffec- 
tive display area. 

[0073] In the example shown in the diagram, the 
ineffective display area includes two areas at the top 
and bottom of the screen (which are hereinafter called 
header 502 and footer 503). Symbols showing the sta- 
tuses of the terminal (e.g. the remainder of the battery, 
strength of received electric waves, etc.) are displayed 
in the header 502 and the footer 503. 
[0074] The effective display area 504 corresponds 
to the area other than the ineffective areas, i.e. the area 
between the header 502 and the footer 503, where an 
image obtained from the WWW server 18 or 19 is dis- 
played as the background image. 

[0075] Part of the effective display area 504 (the 
area shown by the reference number 505 in the dia- 
gram) is used as an ineffective display area as needed. 
An area like the area 505, which is part of the effective 
display area 504 but used as an ineffective display area 
as needed, is called "temporary ineffective display 
area." In contrast, the header 502 and the footer 503 are 
called "static ineffective display area." 
[0076] That is to say, the effective display area 504 
is variable in size. The effective display area 504 in the 
example shown in the diagram can be (80x90) or 
(80x70). 

[0077] In this embodiment, the program imple- 
mented in the browser application 105 in FIG.3 as 
stated above is an image resize/display program for 
changing the size of an image obtained from the WWW 
server 18 or 19 to adjust it to the screen size of the dis- 
play 29 (the display 413 of FIG.4) and displaying the 
image. The CPU 31 operates in accordance with this 
image resize/display program to realize the functions of 



the blocks shown in FIG.4 (which are described below). 
[0078] In FIG.4, the terminal of the first embodiment 
of the invention includes an input unit 401 , an input deci- 
sion unit 402, an size setting unit 403, an size storage 

5 unit 404, a form setting unit 405, an form storage unit 
406, an image obtaining unit 407, an accumulative 
image storage unit 408, an image selecting unit 409, an 
over-size decision unit 410, an image resizing unit 41 1, 
a display image temporary storage unit 412 and a dis- 

10 play 413. 

[0079] The input unit 401 receives entry of instruc- 
tions from a user. The input decision unit 402 recog- 
nizes the instructions received at the input unit 401 (an 
instruction for setting the effective display area size, an 

15 instruction for setting the image resizing form, an 
instruction for obtaining an image, an instruction for 
selecting an image, etc.). The size setting unit 403 sets 
the effective display area size. The size storage unit 404 
stores the effective display area size set by the size set- 

20 ting unit 403. 

[0080] The form setting unit 405 sets the image 
resizing form. The form storage unit 406 stores the 
image resizing form set by the form setting unit 405. 
[0081] The image obtaining unit 407 obtains 

25 images from the WWW servers 18 and 19 through the 
Internet 17. The accumulative image storage unit 408 
accumulatively stores images obtained by the image 
obtaining unit 407. 

[0082] The image selecting unit 409 selects one of 
30 the images accumulatively stored in the accumulative 
image storage unit 408. The over-size decision unit 410 
compares the size of the image selected by the image 
selecting unit 409 with the effective display area size 
stored in the size storage unit 404 to decide whether the 
35 entirety of that image can be displayed within the effec- 
tive display area 504. 

[0083] The image resizing unit 411 changes the 
size of the image selected by the image selecting unit 
409 by using the form stored in the form storage unit 

40 406 so that the image fits the effective display area size 
stored in the size storage unit 404. 
[0084] The display image temporary storage unit 
412 temporarily stores, as a display image, the image 
selected by the image selecting unit 409 or the image 

45 resized by the image resizing unit 411 (i.e. an image 
changed in size). The display 413 displays the image 
stored in the display image temporary storage unit 412 
as the background image in the effective display area 
504. 

so [0085] FIG. 6 is a flowchart showing the operation 
in which the terminal shown in FIG.4 obtains an image 
from the WWW server 18 or 19, changes its size, and 
displays it as a background image in the effective dis- 
play area 504 shown in FIG. 5. Referring to FIGS.4 to 6, 

55 the operation of the terminal of the first embodiment of 
the invention will now be described. 
[0086] In FIG. 6, when power is supplied to the ter- 
minal, then the input unit 401 starts the operation of 
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accepting instruction input from the user (step S101). 
Next, the input decision unit 402 decides whether the 
instruction received at the input unit 401 is an instruction 
for setting the effective display area size (step SI 02). 
Then the result of decision made in step S102 is NO, 
then step S105 follows. 

[0087] When the decision made in step S102 is 
YES, the size setting unit 403 sets the effective display 
area size (step S103). Next, the size storage unit 404 
stores the size set in step S103 by the size setting unit 

403 (step S104). 

[0088] Next, the input decision unit 402 decides 
whether the instruction received at the input unit 401 is 
an instruction for setting the image resizing form (step 
S105). Then the decision made in step S105 is NO, the 
step S108 follows. 

[0089] When the decision made in step S105 is 
YES, the form setting unit 405 sets the image resizing 
form (step S1 06). Next, the form storage unit 406 stores 
the form that the form setting unit 405 set in step S106 
(step S107). 

[0090] Next, the input decision unit 402 decides 
whether the instruction received at the input unit 401 is 
an instruction for obtaining an image (step S1 08). When 
the decision made in step SI 08 is NO, the step S111 
follows. 

[0091] When the decision made in step S108 is 
YES, the image obtaining unit 407 obtains an image 
from the WWW server 18 or 19 through the Internet 17 
(step S109). Next the accumulative image storage unit 
408 accumulatively stores the image obtained in step 
S109 by the image obtaining unit 407 (step S1 10). 
[0092] Next, the input decision unit 402 decides 
whether the instruction received at the input potion 401 
is an instruction for selecting an image (step S111). 
When the decision made in step S1 1 1 is NO, the step 
S1 17 follows. 

[0093] When the decision made in step S111 is 
YES, the image selecting unit 409 selects one from 
among the images accumulatively stored in step St 10 
in the accumulative image storage unit 408 (step S1 12). 
[0094] Next, the over-size decision unit 410 com- 
pares the size of the image selected in step S1 1 0 by the 
image selecting unit 409 with the size of the effective 
display area stored in step S104 in the size storage unit 

404 to decide whether that image exceeds the size limit 
of the effective display area 504 (step S1 13). When the 
decision made in step S113 is NO, the steps S115 to 
S1 17 follow. 

[0095] When the decision made in step S113 is 
YES, the image resizing unit 411 changes the size of 
the image selected in step S107 by the image selecting 
unit 409 by using the form stored in step S107 in the 
form storage unit 406 so that the image fits the effective 
display area size stored in the size storage unit 404 in 
step S104 (step S114). Then the steps S115 to S117 
follow. 

[0096] In step S115, the display image temporary 



storage unit 412 temporarily stores the display image. 
That is to say, the display image temporary storage unit 
412 temporarily stores, as a display image, the image 
selected in step S1 1 0 by the image selecting unit 409 or 

5 the image resized in step S114 by the image resizing 
unit 41 1 (i.e. an image changed in size). 
[0097] In step S116, the display 413 displays the 
image stored in the display image temporary storage 
unit 412 (i.e. the image selected in step S1 12 or the 

10 image resized in step Si 14) as the background image 
within the effective display area 504. 
[0098] In step S117, the input decision unit 402 
decides whether the instruction received at the input 
unit 401 is an instruction for terminating the image dis- 

15 play. Then the decision made in step S1 17 is YES, the 
display 413 terminates the image display; when the 
decision is NO, then the above-described steps S101 to 
S1 17 are executed again. 

[0099] The terminal operates as roughly described 

20 above. 

[0100] Next, important steps among the steps S101 
to S1 1 7 will be described in greater detail. 
[0101] The process of setting and storing the effec- 
tive display area size in steps S103 and S104 is per- 

25 formed as shown below. The size setting unit 403 
contains some previously prepared sizes that can be 
set as the effective display area size; when the user 
presses a particular button in the input unit 401, then 
the size setting unit 403 selects one of the sizes and 

30 sets it as the effective display area size. The size set by 
the size setting unit 403 is stored in the size storage unit 
404. 

[0102] In the example shown in FIG. 5, the size set- 
ting unit 403 sets the size (80x90) or (80x70), and the 

35 set size is stored in the size storage unit 404. 

[0103] Alternatively, the user may operate the key- 
board in the input unit 401 to specify an arbitrary size, 
and the size setting unit 403 may set the specified size 
as the effective display area size. _ . _ 

40 [01 04] The process of setting and storing the image 
resizing form in steps S106 and S107 is performed as 
below. That is to say, the image resizing form setting 
unit 405 contains some previously prepared image 
resizing forms; when the user presses a particular but- 

45 ton in the input unit 401 , the image resizing form setting 
unit 405 selects one of the forms and sets that form as 
the image resizing form. The form set by the form set- 
ting unit 405 is stored in the form storage unit 406. 
[0105] The image resizing forms prepared in the 

so image resizing form setting unit 405 include three, first 
to third, image resizing forms. 

[0106] FIGS.7A to 7C are diagrams visually show- 
ing a first image resizing form, FIGS.8A to 8C are dia- 
grams visually showing a second image resizing form, 
55 and FIGS.9A to 9C are diagrams visually showing a 
third image resizing form. 

[0107] As shown in FIGS.7A to 7C, the first image 
resizing form shrinks an image at the same ratio in the 



10 



BNSDOCID: <EP 1052598A2J_> 



19 EP1052 

longitudinal and lateral (height and width) directions 
(that is, it reduces the resolution by decimating pixels at 
a certain rate). This first form alters the size of the image 
so that its entirety can be accommodated within the 
effective display area with its aspect ratio unchanged 5 
(i.e. without being compressed in shape). 
[0108] As shown in FIGS.8A to 8C, the second 
image resizing form removes part of an image to reduce 
the image size. The second form keeps the resolution 
unchanged, though the parts extending past the effec- w 
tive display area are lost in the resized image. 
[0109] As shown in FIGS.9A to 9C, the third image 
resizing form shrinks an image at separate ratios in the 
longitudinal and lateral directions. This third form alters 
the size of the image so that its entirety can be properly 75 
displayed without loss within the effective display area, 
though its shape is compressed. 

[0110] In the accumulative image storage process- 
ing in step S110, the accumulative image storage unit 
408 assigns sequential numbers (0, 1.2,...), for exam- 20 
pie, to the accumulated images as their identifiers (IDs). 
[0111] The image selecting processing in step 

5112 is performed as follows. When the accumulative 
image storage unit 408 stores only one image in step 
S110, then the image selecting unit 409 selects that 25 
image. 

[0112] When the accumulative image storage unit 

408 stores a plurality of images in step S1 10, then the 

image.selecting unit 409 refers to the identifies given in 

step S110 by the accumulative image storage unit 408 30 

to select one from among the plurality of images. 

[01 1 3] An example of the simplest selecting method 

is shown here. That is to say, when the accumulative 

image storage unit 408 stores three images (ID = 1 to 3) 

in step S1 10, then the image selecting unit 409 selects 35 

the first image (ID = 1 ), for example. 

[0114] The over-size decision processing in step 

51 13 is performed as follows. 

[0115] The over-size decision unit 410 first detects 
the size of the image that was selected in step S1 1 2 by 40 
the image selecting unit 409. Images supplied from the 
WWW servers 18 and 19 contain data indicating their 
size, which allows detection of the image size. 
[0116] Next the over-size decision unit 410 com- 
pares the size of the image with the size of the effective 45 
display area in the lateral direction and in the longitudi- 
nal direction to decide whether the image can be dis- 
played within the screen. 

[0117] The image size changing process in step 

51 1 4 is performed as shown below. 50 

(1) When the form storage unit 406 stores the first 
form in step S107 and the over-size decision unit 
410 decides that it is over size in the lateral direc- 
tion in the over-size decision process in step S1 13, 55 
then the image resizing unit 41 1 calculates such a 
resizing ratio that the lateral size of the resized 
image coincides with the lateral size of the effective 
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display area and shrinks the image at that resizing 
ratio both in the longitudinal and lateral directions. 
FIG.7A shows an example of the processing 

(1) . In this example, the over-size decision unit 410 
compares the lateral dimension 120 of the image 
with the lateral dimension 80 of the effective display 
area and decides that the image exceeds the lateral 
size limit. Accordingly the image resizing unit 411 
divides 80 by 120 to obtain the resizing ratio (2/3). 
Then it shrinks the image to (2/3) both in the longi- 
tudinal and lateral directions on the basis of the first 
form. 

(2) When the form storage unit 406 stores the first 
form in step S107 and the over-size decision unit 
41 0 decides that it is over size in the longitudinal 
direction in the over-size decision process in step 
S113, then the image resizing unit 411 calculates 
such a resizing ratio that the longitudinal size of the 
resized image coincides with the longitudinal size of 
the effective display area and shrinks the image at 
that resizing ratio both in the longitudinal and lateral 
directions. 

FIG. 7B shows an example of the processing 

(2) . In this example, the over-size decision unit 410 
compares the longitudinal dimension 150 of the 
image with the longitudinal dimension 90 of the 
effective display area and decides that the image 
exceeds the longitudinal size limit. Accordingly the 
image resizing unit 411 divides 90 by 150 to obtain 
the resizing ratio (3/5). Then it shrinks the image to 
(3/5) both in the longitudinal and lateral directions 
on the basis of the first form. 

(3) Then the form storage unit 406 stores the first 
form in step S107 and the over-size decision unit 
410 decides that it is over size in the longitudinal 
and lateral directions in the over-size decision proc- 
ess in step S1 13 then the image resizing unit 411 
calculates such a resizing ratio that the longitudinal 
size of the resized image coincides with the longitu- 
dinal size of the effective display area and such a 
resizing ratio that the lateral size of the resized 
image coincides with the lateral size of the effective 
display area. The image resizing unit 411 then 
shrinks the image at a smaller one of the two resiz- 
ing ratios both in the longitudinal and lateral direc- 
tions. 

FIG.7C shows an example of the processing 
(3). In this example, the over-size decision unit 410 
compares the lateral dimension 120 of the image 
with the lateral dimension 80 of the effective display 
area and decides that the image exceeds the lateral 
size limit. It also compares the longitudinal dimen- 
sion 150 of the image with the longitudinal dimen- 
sion 90 of the effective display area and decides 
that the image exceeds the longitudinal size limit. 
Accordingly the image resizing unit 41 1 divides 80 
by 120 to obtain the resizing ratio (2/3), and also, it 
divides 90 by 150 to obtain the resizing ratio (3/5). 
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Then the image resizing unit 41 1 shrinks the image 
to (3/5) both in the longitudinal and lateral directions 
on the basis of the first form (because (3/5) is 
smaller than (2/3)). 

(4) When the form storage unit 406 stores the sec- 5 
ond form in step S107 and the over-size decision 
unit 410 decides that it is over size in the lateral 
direction in the over-size decision process in step 
S1 1 3, then the image resizing unit 41 1 removes the 
parts near the left and right ends of the image which 10 
are supposed to extend past the limits of the effec- 
tive display area. 

F1G-8A shows an example of the processing 

(4) . In this example, the over-size decision unit 410 
compares the lateral dimension 120 of the image 15 
with the lateral dimension BO of the effective display 
area and decides that the image exceeds the lateral 
size limit. Accordingly the image resizing unit 41 1 
removes the left end (which corresponds to a lateral 
dimension of 20) and the right end (which corre- 20 
sponds to a lateral dimension of 20) from the image 

on the basis of the second form. Alternatively, 
instead of equally removing the right and left ends 
of the image, only the left end (corresponding to a 
lateral dimension of 40) or only the right end (corre- 25 
sponding to a lateral dimension of 40) may be 
removed. 

(5) When the form storage unit 406 stores the sec- 
ond form in step S107 and the over-size decision 
unit 41 0 decides that it is over size in the longitudi- 30 
nal direction in the over-size decision process in 
step S113, then the image resizing unit 411 
removes the parts near the upper and lower ends of 
the image which are supposed to extend past the 
limits of the effective display area. 35 

FIG. 8B shows an example of the processing 

(5) . In this example, the over-size decision unit 410 
compares the longitudinal dimension 150 of the 
image with the longitudinal dimension 90 of the 
effective display area and decides that the image 40 
exceeds the longitudinal size limit. Accordingly the 
image resizing unit 411 removes the upper end 
(which corresponds to a longitudinal dimension of 
30) and the lower end (which corresponds to a lon- 
gitudinal dimension of 30) from the image on the 45 
basis of the second form. Alternatively, instead of 
equally removing the upper and lower ends of the 
image, only the upper end (corresponding to a lon- 
gitudinal dimension of 60) or only the lower end 
(corresponding to a longitudinal dimension of 60) so 
may be removed. 

(6) When the form storage unit 406 stores the sec- 
ond form in step S107 and the over-size decision 
unit 410 decides that it is over size in the longitudi- 
nal and lateral directions in the over-size decision 55 
process in step S113, then the image resizing unit 

41 1 first removes the left and right ends of the 
image which are supposed to extend past the limits 



of the effective display area and then removes the 
upper and lower ends of the image which are sup- 
posed to extend past the limits of the effective dis- 
play area. 

FIG.8C shows an example of the processing 

(6) . In this example, the over-size decision unit 41 0 
compares the lateral dimension 120 of the image 
with the lateral dimension 80 of the effective display 
area and decides that the image exceeds the lateral 
size limit. The over-size decision unit 410 also com- 
pares the longitudinal dimension 150 of the image 
with the longitudinal dimension 90 of the effective 
display area and decides that the image exceeds 
the longitudinal size limit. Accordingly, on the basis 
of the second form, the image resizing unit 41 1 first 
removes the left end of the image (which corre- 
sponds to a lateral dimension of 20) and the right 
end (which corresponds to a lateral dimension of 
20) from the image and then it removes the upper 
end (which corresponds to a longitudinal dimension 
of 30) and the lower end (which corresponds to a 
longitudinal dimension of 30). 

(7) When the form storage unit 406 stores the third 
form in step S107 and the over-size decision unit 
410 decides that it is over size in the lateral direc- 
tion in the over-size decision process in step S1 13, 
then the image resizing unit 41 1 calculates such a 
resizing ratio that the lateral size of the converted 
image coincides with the lateral size of the effective 
display area and shrinks the image at that resizing 
ratio in the lateral direction. 

FIG.9A shows an example of the processing 

(7) . In this example, the over-size decision unit 410 
compares the lateral dimension 120 of the image 
with the lateral dimension 80 of the effective display 
area and decides that the image exceeds the lateral 
size limit. Accordingly the image resizing unit 411 
divides 80 by 120 to obtain the resizing ratio (2/3). 
Then the image resizing unit 41 1 shrinks the image 
to (2/3) in the lateral direction on the basis of the 
third form. 

(8) When the form storage unit 406 stores the third 
form in step S107 and the over-size decision unit 
410 decides that it is over size in the longitudinal 
direction in the over-size decision process in step 
S113, then the image resizing unit 411 calculates 
such a resizing ratio that the longitudinal size of the 
resized image coincides with the longitudinal size of 
the effective display area and shrinks the image at 
that resizing ratio in the longitudinal direction. 

FIG.9B shows an example of the processing 
(8). In this example, the over-size decision unit 410 
compares the longitudinal dimension 150 of the 
image with the longitudinal dimension 90 of the 
effective display area and decides that the image 
exceeds the longitudinal size limit. Accordingly the 
image resizing unit 411 divides 90 by 150 to obtain 
the resizing ratio (3/5). Then the image resizing unit 
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41 1 shrinks the image to (3/5) in the longitudinal 
direction on the basis of the third form. 
(9) When the form storage unit 406 stores the third 
form in step S107 and the over-size decision unit 
410 decides that it is over size in the longitudinal 5 
and lateral directions in the over-size decision proc- 
ess in step S1 13, then the image resizing unit 41 1 
calculates such a resizing ratio that the lateral size 
of the resized image coincides with the lateral size 
of the effective display area and such a resizing to 
ratio that the longitudinal size of the resized image 
coincides with the longitudinal size of the effective 
display area. Then the image resizing unit 41 1 first 
shrinks the image at the former resizing ratio in the 
lateral direction and next shrinks the laterally- is 
shrunk image at the latter resizing ratio in the longi- 
tudinal direction. 

FIG.9C shows an example of the processing 
(9). In this example, the over-size decision unit 410 
compares the lateral dimension 120 of the image 20 
with the lateral dimension 80 of the effective display 
area and decides that the image exceeds the lateral 
size limit. It also compares the longitudinal dimen- 
sion 150 of the image with the longitudinal dimen- 
sion 90 of the effective display area and decides 25 
that the image exceeds the longitudinal size limit. 
Accordingly the image resizing unit 41 1 divides 80 
by 120 to obtain the resizing ratio (2/3) and also 
divides 90 by 150 to obtain the resizing ratio (3/5) 
Then, on the basis of the third form, the image 30 
resizing unit 41 1 first shrinks the image in the lateral 
direction to (2/3) and next shrinks the laterally- 
shrunk image to (3/5) in the longitudinal direction. 

•• {0118] Although the terminal obtains images from 35 
the WWW servers 18 and 19 through the Internet 17 in 
the example described above, the subject which obtains 
images may be an information terminal device other 
than the mobile terminal, such as a portable information 
terminal, for example. The source of image acquisition 40 
may be a server other than the WWW servers 1 8 and 
19, such as a mail server, for example. The medium for 
transmitting images may be a network other than the 
Internet 1 7, such as a communication network or CATV 
network, for example. 45 
[0119] As has been described above, this embodi- 
ment enables the operation of obtaining an image from 
a server, changing the size of the image, and utilizing 
the image as a background image. 

[0120] When selecting one of a plurality of images so 
in the image selecting process of step S1 12, the image 
selecting unit 409 in the example of the embodiment 
automatically selects the first image from among a plu- 
rality of images. Alternatively, the user may arbitrarily 
specify an image to be selected through the input unit 55 
401. In this case, the image selecting unit 409 selects 
the image specified by the user. 

[0121] In an application in which an image is 



selected from among a plurality of images in accord- 
ance with an instruction from a user, the device will be 
further provided with an image list box generating unit 
and the image selecting unit 409 will be equipped with a 
focusing function and a decision function, for example. 
[01 22] The image list box generating unit generates 
an image list box composed of a plurality of boxes each 
including an image or information (hereinafter referred 
to as image information) associated with the corre- 
sponding image and allowing the user to identify the 
image. 

[01 23] It is recommended that the storage locations 
of images ("moon. g*rf," "star, g'rf," etc.) should be used 
as the image information in the image list box. This is 
because the user can instantaneously understand the 
correspondence between the storage locations and 
images since they are associated with each other and 
the storage locations usually contain the name of 
images. Furthermore, the image storage locations can 
be easily obtained by analyzing the HTML documents 
because HTML documents have been obtained from 
the WWW servers 18 and 19 prior to the acquisition of 
images. 

[01 24] The image selecting unit 409 focuses on one 
of the plurality of boxes in the image list box and moves 
the focus up and down (and/or right and left) in 
response to key operation by the user. When the user 
enters a determination through key operation with a cer- 
tain box being focused on, the image selecting unit 409 
selects the image (or image information) in that box. 

(Second Embodiment) 

[0125] FIG. 10 is a block diagram showing the func- 
tional structure of a terminal according to a second 
embodiment of the invention. The terminal shown in 
FIG. 10 corresponds to the terminals 10 and 11 shown 
in FIG.1. Its hardware structure is shown in FIG.2 and 
the software structure of the communication application 
unit 30 of FIG.2 is shown in FIG.3. 
[0126] FIG.1 1 is a schematic diagram showing an 
example of the structure of a display area 1 101 on the 
screen in the display 1 01 3 of FIG.1 0 and that of the key- 
board in the input unit 1001. In FIG.1 1, the keyboard 
has a ten-key pad 1102 for entry of dial numbers and 
characters, an up key 1 1 03, a down key 1 1 04, a left key 
1 1 05, a right key 1 1 06 and an enter key 1 1 07 for select- 
ing information. It is assumed here that information is 
selected by using the up key 1 103, down key 1 104 and 
enter key 1 1 07. 

[0127] In this embodiment the program imple- 
mented in the browser application 105 in FIG.3 is a pro- 
gram for selecting and using one of pieces of 
information contained in an HTML document obtained 
from the WWW server 18 or 19, which is typically an 
image select/display program for selecting one of the 
storage locations of plural pages of images and display- 
ing the image. The CPU 31 operates in accordance with 
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this image select/display program to realize the func- 
tions of the blocks shown in FIG. 10 (which are 
described below). 

[0128] In FIG. 10, the terminal according to a sec- 
ond embodiment of the invention includes an input unit 
1001, an input decision unit 1002, an type setting unit 
1003, a type storage unit 1004, an HTML obtaining unit 
1005, an HTML accumulative storage unit 1006, an 
analyzing unit 1007, an HTML element information 
accumulative storage unit 1008, an information extract- 
ing unit 1009, an information storage unit 1010, an infor- 
mation list box generating unit 101 1 , an information list 
box temporary storage unit 1012, a display 1013, an 
information selecting unit 1014, an element obtaining 
unit 1015, and a display image temporary storage unit 
1016. 

[0129] The input unit 1 001 receives instruction input 
from a user. The input decision unit 1002 recognizes 
instructions received at the input unit 1001 (an instruc- 
tion for setting the extracted element type, an instruction 
for obtaining an HTML document, an instruction for 
selecting information, etc.). The type setting unit 1003 
sets the extracted element type ("image" here). The 
type storage unit 1004 stores the extracted element 
type set by the type setting unit 1 003. 
[0130] The HTML obtaining unit 1005 obtains 
HTML documents and images from the WWW servers 
;E and 19 through the Internet 17. The HTML accumu- 
lative storage unit 1 006 accumulatively stores the HTML 
documents and images obtained by the HTML obtaining 
unit 1005. The analyzing unit 1007 analyzes the HTML 
documents accumulatively stored in the HTML accumu- 
lative storage unit 1006. The HTML element information 
accumulative storage unit 1008 accumulatively stores 
HTML element information analyzed by the analyzing 
unit 1 007. 

[0131] The information extracting unit 1 009 extracts 
information contained in elements belonging to the type 
(image) stored in the type storage unit 1004 (the stor- 
age locations of images) from the HTML element infor- 
mation accumulatively stored in the HTML element 
information accumulative storage unit 1008. The infor- 
mation storage unit 1010 stores the information 
extracted by the information extracting unit 1009. The 
information list box generating unit 1011 generates an 
information list box describing the information stored in 
the information storage unit 1010 (storage locations of a 
plurality of images). The information list box temporary 
storage unit 1 012 temporarily stores the information list 
box generated by the information list box generating unit 
1011. 

[0132] The display 1013 displays the information list 
box temporarily stored in the information list box tempo- 
rary storage unit 1012 and also displays an image tem- 
porarily stored in the display image temporary storage 
unit 1 01 6 within the display area 1101. The information 
selecting unit 1 01 4 selects one of the information pieces 
(storage locations of a plurality of images) stored in the 



information storage unit 1010. The element obtaining 
unit 1015 obtains the element (image) corresponding to 
the information selected by the information selecting 
unit 1014 from the HTML accumulative storage unit 

5 1 006 if it is present therein, or the element obtaining unit 
1015 externally obtains the element if it is not therein 
(here, the element obtaining unit 1015 requests the 
HTML obtaining unit 1005 to obtain the element from 
the WWW server 18 or 19 through the Internet 17). The 

to display image temporary storage unit 1016 temporarily 
stores the image obtained by the element obtaining unit 
1015 as a display image. 

[0133] FIG. 12 is a flowchart showing a series of 
operations in which the terminal shown in FIG. 10 ana- 

15 lyzes an HTML document, extracts information showing 
storage locations of images from the analyzed results 
(i.e. HTML element information), generates and dis- 
plays an information list box, selects one of the storage 
locations of the plurality of images in accordance with a 

20 selecting instruction from a user, obtains the image from 
the selected storage location, and displays it as the 
background image. The operation of the terminal of the 
second embodiment of the invention will now be 
described in detail referring to FIGS. 10 to 12. 

25 [0134] in FIG. 12, when the power is turned on in 
this terminal, the input unit 1001 starts the operation of 
accepting instruction input from a user (step S201). 
Next the input decision unit 1002 decides whether the 
instruction received at the input unit 1001 is an instruc- 

30 tion for setting the extracted element type (step S202). 
When the decision made in step S202 is NO, the step 
S205 follows. 

[0135] When the decision made in step S202 is 
YES, the type setting unit 1003 sets the extracted ele- 

35 ment type (step S203). Next the type storage unit 1004 
stores the extracted element type which was set in step 
S203 by the type setting unit 1003 (step S204). 
[01 36] Now the extracted element type setting proc- 
ess Jn the step S203 and the extracted element type 

40 storage process in step S204 will be described in 
greater detail. The type setting unit 1003 contains a plu- 
rality of extracted element types previously provided. It 
is assumed here that the three extracted element types 
"text," "link" and "image" are provided. 

45 [0137] When the power is turned on in the terminal 
for the first time, the type setting unit 1 003 initializes the 
extracted element type. In the initialization, the type set- 
ting unit 1003 sets "image" as the extracted element 
type and the type storage unit 1 004 stores the set type 

so "image." 

[0138] When the user presents an extracted ele- 
ment type setting instruction, the type setting unit 1003 
sets the extracted element type again. In the re-setting, 
the type setting unit 1003 sets the extracted element 
55 type indicated by the user (e.g. "link") and the type stor- 
age unit 1 004 stores the set type "link." 
[0139] It is assumed in the description below that 
the type storage unit 1004 stores "image" as the 
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extracted element type in step S204. 
[0140] Referring to FIG. 12 again, the input decision 
unit 1002 next determines whether the instruction 
received at the input unit 1001 is an HTML document 
obtaining instruction (step S205). When the decision 5 
made in step S205 is NO, the flow returns to step S201 
and the input unit 1001 accepts the next instruction 
input. 

[0141] When the decision made in step S205 is 
YES, the HTML obtaining unit 1005 obtains an HTML io 
document from the WWW server 18 or 19 through the 
Internet 17 (step S206). Next the HTML accumulative 
storage unit 1006 accumulatively stores the HTML doc- 
ument obtained in step S206 by the HTML obtaining 
unit 1005 (step S207). is 
[0142] Next the analyzing unit 1007 analyzes the 
HTML document accumulatively stored in step S207 in 
the HTML accumulative storage unit (step S208). Next 
the HTML element information accumulative storage 
unit 1008 accumulatively stores the HTML element 20 
information analyzed in step S208 by the analyzing unit 
1007 (step S209). 

[0143] Now the HTML document analyzing process 
in the step S208 and the HTML element information 
accumulative storage process in the step S209 will be 25 
described in detail. 

[0144] FIG. 13 is a diagram showing an example of 
an HTML document accumulatively stored in the HTML 
accumulative storage unit 1006 in the step S207 of 
FIG. 12. In FIG.13, the HTML document is composed of 30 
seven lines, the first to seventh lines (1301 to 1307). 
[0145] FIG. 14 is a flowchart showing the details of 
the HTML document analyzing process in the step S208 
of FIG. 12. Now the analysis of the HTML document per- 
formed by the analyzing unit 1007 will be described 35 
referring to FIGS. 13 and 14. 

[0146] In FIG. 14, the analyzing unit 1007 first disas- 
sembles the HTML document accumulatively stored by 
the HTML accumulative storage unit 1006 in step S207 
of FIG. 12 (step S301). Then the HTML document ana- 40 
lyzing unit 1007 provides identifiers (IDs) to the individ- 
ual elements (step S302). Sequential numbers starting 
from zero are used as the IDs here. Accordingly, when 
N elements are obtained in the disassembly of step 
S301, then IDs = 0, 1,2, ... (N-1) are assigned to the 45 
elements. 

[0147] Next, the analyzing unit 1007 sets the initial 
value (zero, here) in M k" indicating the identifier of the 
element to be analyzed (step S303). Next the analyzing 
unit 1007 decides whether the element "k" includes so 
some piece of previously provided information and then 
specifies, on the basis of the decision, which of the pre- 
viously provided element types the element "k" belongs 
to (step S304). 

[0148] Next the analyzing unit 1007 notifies the 55 
HTML information accumulative storage unit 1006 of the 
analyzed results obtained in step S304, i.e. the element 
type of the element "k" and the information it contains 



(step S305). 

[0149] Next the analyzing unit 1007 increments °k" 
(step S306) and then decides whether "k" is larger than 
"N - 1" (step S307). Then the decision made in step 
S307 is NO, the analyzing unit 1007 returns to step 
S304 and repeats the same processing, and ends the 
processing when a decision of YES is made. 
[0150] The series of processes is now more specif- 
ically described in an example in which the HTML docu- 
ment shown in FIG.13 is analyzed. In the steps S301 
and S302, the analyzing unit 1007 divides the HTML 
document into lines and provides IDs 0 to 6 to the ele- 
ments, regarding the information described in each of 
the lines 1301 to 1307 as one element in the HTML doc- 
ument. Then, in step S304, the analyzing unit 1007 
decides the following factors about the elements pro- 
vided with IDs 0 to 6 (i.e. about the first to seventh lines 
1301 to 1307 in FIG.13). 

(I) whether it contains a character string; 

(II) whether it contains a storage location; 

(III) whether it contains a linked location. 

Then, on the basis of the decisions made on the factors 
(I) to (III), the analyzing unit 1007 specifies which of the 
previously provided three element types "text," ■link" 
and "image" each element belongs to. 
[0151] That is to say, the analyzing unit 1007 first 
decides that the element of ID = 0 (the first line 1301) 
contains a character string but no storage location nor 
link information, and then specifies on the basis of the 
decision that its element type is "text." Next, the analyz- 
ing unit 1 007 decides that the element of ID = 1 (the 
second line 1302) contains a character string and link 
information but no storage location, and then specifies 
on the basis of the decision that its element type is 
"link." Next, the analyzing unit 1007 decides that the 
element of ID = 2 (the third line 1303) contains a storage 
location but no character string nor link information, and 
then specifies on the basis of the decision that its ele- 
ment type is "image." The analyzing unit 1007 examines 
the elements of IDs 3 to 6 (the fourth to seventh lines 
1304 to 1307) in the same way and specifies their ele- 
ment types on the basis of the decisions. 
[0152] The HTML element information accumula- 
tive storage unit 1008 receives the results analyzed by 
the analyzing unit 1 007 and accumulatively stores them 
as HTML element information. 

[0153] FIG. 15 is a diagram showing an example of 
the HTML element information accumulatively stored in 
the HTML element information accumulative storage 
unit 1 008 of FIG.1 0 (the information obtained by analyz- 
ing the HTML document of FIG.13). In FIG. 15, the 
HTML element information includes the type (here, 
"text" "link" or "image") of elements (ID=0 to 6) in the 
HTML document and the information contained in each 
element (here, character string, storage location and 
linked location). 
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[0154] The character string is information indicating 
the name of the element or the entire HTML document 
("information about celestial objects," etc.), the storage 
location is information indicating the location in which 
the entity of that element is stored ("moon, gif" etc.), and 5 
the linked location is information indicating a location 
linked to that element ("moon, html" etc.) 
[0155] Referring to FIG. 12 again, the information 
extracting unit 1009 next extracts the information con- 
tained in the elements which belong to the type 10 
("image") stored in step S204 in the type storage unit 
1 004 from the HTML element information accumula- 
tively stored in step S209 in the HTML element informa- 
tion accumulative storage unit 1008 (step S210). 
[0156] Accordingly, extracted from the HTML ele- 15 
ment information shown in FIG. 15 are the information 
pieces contained in the elements belonging to "image" 
(the three elements provided with IDs 2, 4 and 6), i.e. 
the three storage locations of images, "moon, gif," "sun. 
gif" and "star, gif." 20 
[0157] Next, the information storage unit 1010 
stores the information extracted by the information 
extracting unit 1009 in step S210 (step S211). Next the 
information list box generating unit 1011 generates an 
information list box in which the information stored in 25 
step S211 in the information storage unit 1010 is 
described (step S212). This information list box is com- 
posed of the same number of boxes as the information 
pieces extracted by the information extracting unit 1009 
instepS210. 30 
[01 58] Next, the information list box temporary stor- 
age unit 1 012 temporarily stores the information list box 
generated by the information list box generating unit 
1011 in step S212 (step S213). Next the display 1013 
displays the information list box stored by the list tempo- 35 
rary storage unit in step S213 (step S214). 
[0159] FIG.16 is a diagram showing an example of 
the information list box that the display 1 013 displays in 
step S21.4. In EIG J 6, the information list box contains 
three boxes 1601 to 1603 vertically arranged in a line. 40 
When the boxes are called the zeroth box, first box ... in 
order from the uppermost box 1601 , then the zeroth box 
1601 contains "moon, gif," the first box 1602 contains 
"sun. gif" and the second box 1603 contains "star, gif." 
[0160] In the information list box shown in FIG.16, 45 
the storage locations of the entities of the images are 
described in the character form as "moon, gif," "sun. gif" 
and "star, gif." Alternatively, they may be described as 
images of moon, sun and star as shown in FiG.1 7 by 
obtaining the entities of the images from their storage 50 
locations. 

[0161] Referring to FIG. 12 again, next, the input 
decision unit 1002 decides whether the instruction 
accepted at the input unit 1001 is an information select- 
ing instruction (step S215). When the decision made in 55 
step S215 is NO, the flow returns to step S201 and the 
input unit 1001 accepts the next instruction input. 
[0162] When the decision made in step S215 is 
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YES, the information selecting unit 1014 selects one of 
the information pieces that the information storage unit 
1 01 0 stored in step S21 1 (step S21 6). 
[0163] The information selecting processing in step 
S216 is now be described in detail. 
[01 64] FIG.1 8 is a block diagram showing the struc- 
ture of the information selecting unit 1014 of FIG.1 0. In 
FIG.1 8, the information selecting unit 1014 includes a 
focusing unit 1801 and a decision unit 1802. 
[0165] The focusing unit 1801 focuses on a single 
box in the information list box displayed by the display 
1013. 

[0166] "Focusing on a single box" means the 
processing of varying the displayed state of that box so 
that it can be visually distinguished from other boxes; it 
may be the processing of enhancing the outline of that 
box, or varying its brightness or color, for example. In 
the description below, as shown in FIG.1 9, the window 
frame 1901 applied to the box 1602 in the information 
list box is referred to as focus 1 901 . 
[0167] When the up and down keys 1 103 and 1104 
in the input unit 1001 are pressed with a certain box 
being focused on in the information list box displayed by 
the display 1013, then the focusing unit 1 801 moves the 
focus to the upper or lower box accordingly. That is to 
say, in the information list box of FIG.1 9, the focus 191 1 
applied to the box 1 602 is moved to the upper adjacent 
box 1601 when the up key 1103 is pressed, and it is 
moved to the lower adjacent box 1603 when the down 
key 1 1 04 is pressed. 

[01 68] When the enter key 1 1 07 is pressed with the 
focusing unit 1802 focusing on a certain box in the infor- 
mation list box displayed by the display 1013 (see 
FIG. 19), then the setting unit 1802 sets the information 
described in that box as information selected by the 
information selecting unit 1014. 

[0169] F1G.20 is a flowchart showing the details of 
the selecting processing performed in step S216 of 
FIG. 12. The character "max_num" shown jn FIG.20 
indicates the number of information pieces extracted by 
the information extracting unit 1009 in step S210 of 
FIG. 12. The character "id" indicates the box presently 
focused on by the focusing unit 1 801 among the plural- 
ity of boxes forming the information list box displayed in 
step S214 by the display 1 01 3 (the three, zeroth to sec- 
ond, boxes 1601 to 1603 here). 

[0170] In FIG.20, first, the focusing unit 1801 per- 
forms initialization (step S401). In this initialization, the 
initial value (0, here) is set in "id" and the number of 
extracted information pieces (3, here) is set in 
"max_num." 

[0171] Next the focusing unit 1801 focuses on the 
"id"th box in the information list box displayed by the dis- 
play 1 013 (see FlG.19:step S402). That is to say, the Oth 
(i.e. the uppermost) box 1601 is focused on at the 
beginning of the selecting processing. 
[0172] Next the input decision unit 1002 decides 
which of the up key 1 103, down key 1 104 and enter key 
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1107 was pressed and notifies the focusing unit 1801 
and the setting unit 1802 (step S403) of the decision. 
[0173] When the down key 1104 is pressed, the 
focusing unit 1801 performs the following processing. 
First, it increments "id" (step S404) and next decides 
whether "id" is larger than °max_num - 1 " (step S405). 
When the decision made in step S405 is NO, the focus- 
ing unit 1801 goes back to step S402 and focuses on 
the "id"th box. 

[0174] When the decision made in step S405 is 
YES, the focusing unit 1801 sets "lid" back to the initial 
value (0 here: step S406) and returns to step S402. 
[0175] That is to say, when the down key 1104 is 
pressed, the focus applied to a certain box is moved to 
the lower adjacent box (for example, the focus applied to 
the first box 1602 is moved to the second box 1603). 
However, when the down key 1 104 is pressed with the 
focus being applied to the lowermost box (the second 
box 1603 here), then the focus is jumped to the upper- 
most box (the Oth box 1601 here). 

[01 76] When the key 1 1 03 is pressed, the focussing 
unit 1801 performs the following processing. First it dec- 
rements "id" (step S407) and then decides whether "id" 
is smaller than zero (step S408). When the decision 
made in step S408 is NO, the focusing unit 1801 goes 
back to step S402 and focuses on the "id"th box. 
[0177] When the decision made in step S408 is 
YES, the focusing unit 1801 sets "max.num - 1" in "id" 
(step S409) and goes back to step S402. 
[0178] That is to say, when the up key 1103 is 
pressed, the focus applied to a certain box is moved to 
the upper. adjacent box (for example, the focus applied 
to the first box 1 602 is moved to the Oth box 1 601 ). How- 
ever, when the up key 1 1 03 is pressed with the focus 
applied to the uppermost box (the Oth box 1 601 here), 
then the focus is jumped to the lowermost box (the sec- 
ond box 1 603 here). 

[0179] When the enter key 1 1 07 is pressed, the set- 
ting unit 1802 sets the information described in the box 
being focused on by the focusing unit 1 801 as the infor- 
mation selected by the information selecting unit 1014 
(step S410) and the information selecting processing is 
ended. 

[0180] Referring to FIG. 12 again, next, the element 
obtaining unit 1015 determines whether the element 
(image) corresponding to the information (storage loca- 
tion) that the information selecting unit 1014 selected in 
step S216 is present in the HTML accumulative storage 
unit 1006 (step S217). When the decision made in step 
S217 is YES, the element obtaining unit 1015 obtains 
that element from the HTML accumulative storage unit 
1 006 (step S21 8) and then the step S221 is performed. 
[0181] When the decision made in step S217 is NO, 
the element obtaining unit 1015 obtains that element 
from outside of this terminal: herein, it requests the 
HTML obtaining unit 1005 to obtain that element from 
the WWW server 18 or 1 9 through the Internet 17 (step 
S219) and the HTML accumulative storage unit 1006 
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accumulatively stores that element (step S220). Then 
the step S221 is performed. 

[0182] In the description below, it is assumed that 
the element obtaining unit 1015 has obtained in step 
5 S219 the image stored in the location "moon. gif (the 
element provided with ID = 2 in FIG. 1 5) from the WWW 
server 18 or 19 through the Internet 17. 
[0183] Next, the display image temporary storage 
unit 1016 temporarily stores the image obtained by the 
w element obtaining unit 1 01 5 in step S21 9 as the display 
image (step S221) and then the display 1013 displays 
the image stored in the display image temporary stor- 
age unit 1016 in the display area 1101 as the back- 
ground image (step S222). 
15 [0184] Next, the input decision unit 1002 decides 
whether the instruction accepted at the input unit 1001 
is an image display terminating instruction (step S223). 
When the decision made in step S223 is YES, the dis- 
play 1 01 3 terminates the image display, and when it is 
20 NO, the steps S201 to S223 are performed again. 

[0185] The terminal operates as described above. 
[0186] While the description above has shown an 
example in which "image" is set as the extracted ele- 
ment type, the terminal operates as shown below when 
25 "link" is set, for example. 

[0187] The terminal extracts the linked location 
"moon, html," "sun. html" and "star, html" contained in 
the elements belonging to the "link" (i.e. the elements 
having ID = 1, 3 and 5) from the HTML document of 
30 FIG. 15 and displays an information list box describing 
the three linked locations. Then, when the user speci- 
fies any linked location, the terminal selects that linked 
location as described above. Then the terminal 
accesses to that linked location, for example. 
35 [0188] In the description above, the information list 
box is composed of a plurality of boxes (1601 to 1603) 
vertically arranged in a line and the focusing unit 1801 
moves the focus up and down as the up and down keys 
1103 and 1104 are pressed. However, the information 
40 list box may be composed of a plurality of boxes which 
are two-dimensional ly arranged. In this case, the focus- 
ing unit 1 801 moves the focus up, down, right and left as 
the up, down, right and left keys 1103 to 1106 are 
pressed. 

45 [0189] Further, while the terminal obtains images 
from the WWW servers 18 and 19 through the Internet 
17 in the description above, the subject which obtains 
images can be an information terminal device other 
than a terminal, and the source of the images can be a 

so server other than the WWW servers 1 8 and 1 9, and the 
medium transmitting the images can be a network other 
than the Internet 17, as already stated in the first 
embodiment. 

[0190] As has been described so far, this embodi- 
55 ment enables the processing of accumulatively storing 
images obtained from a server and selecting and dis- 
playing an image that the user desires from among the 
accumulated images. 



17 



BNSDCCID: <EP 10S2598A2_I_> 



33 



EP 1 052 598 A2 



34 



[0191] While the invention has been described in 
detail, the foregoing description is in ail aspects illustra- 
tive and not restrictive, It is understood that numerous 
other modifications and variations can be devised with- 
out departing from the scope of the invention. 

Claims 

1. An information terminal device (10) which obtains 
an image from a server (1 8) and displays the image 
in a display area (504) of a screen, comprising: 

an obtaining unit (407) operable to obtain the 
image from said server; 

an over-size decision unit (410) operable to 
decide whether the entirety of the image 
obtained by said obtaining unit can be dis- 
played within said display area of said screen; 
and 

a resizing unit (411) operable to, when said 
over-size decision unit makes a negative deci- 
sion, change the size of the image obtained by 
said obtaining unit so that the image can be 
displayed within said display area of said 
screen. 

2. The information terminal device according to claim 
1, wherein said over-size decision unit detects the 
size of the image obtained by said obtaining unit 
and compares the size of the image with the size of 
the display area of said screen to decide whether 
the entirety of the image can be displayed within the 
display area of said screen. 

3. The information terminal device according to claim 
1 , wherein said display area of said screen is varia- 
ble in size, and 

said over-size decision unit detects the size of 
the image obtained by said obtaining unit and 
the size of said display area of said screen and 
compares the two sizes with each other to 
decide whetherthe entirety of the image can be 
displayed within said display area of said 
screen. 

4. The information terminal device according to claim 
3, wherein said over-size decision unit notifies said 
resizing unit of said detected two sizes, and 

said resizing unit calculates an enlarg- 
ing/shrinking ratio on the basis of said two 
sizes notified by said over-size decision unit 
and changes the size of the image obtained by 
said obtaining unit by enlarging/shrinking the 
image at said enlarging/shrinking ratio. 

5. The information terminal device according to claim 



1, wherein said display area of said screen is varia- 
ble in size, and 

said over-size decision unit detects the lateral 
5 size and the longitudinal size of the image 

obtained by said obtaining unit and the lateral 
size and the longitudinal size of said display 
area of said screen and compares said two lat- 
eral sizes with each other and said two longitu- 
10 dinal sizes with each other to decide whether 

the entirety of said image can be displayed 
within said display area of said screen individu- 
ally in the lateral direction and in the longitudi- 
nal direction. 

15 

6. The information terminal device according to claim 
5, wherein said over-size decision unit notifies said 
resizing unit of said detected two longitudinal sizes 
and said two lateral sizes, and 

20 

said resizing unit calculates an enlarg- 
ing/shrinking ratio in the lateral direction on the 
basis of said two lateral sizes notified by said 
over-size decision unit and calculates an 

25 enlarging/shrinking ratio in the longitudinal 

direction on the basis of said two longitudinal 
sizes, and changes the size of the image 
obtained by said obtaining unit by enlarg- 
ing/shrinking the image in the lateral direction 

30 and in the longitudinal direction at a smaller 

one of said two enlarging/shrinking ratios. 

7. The information terminal device according to claim 
5, wherein said over-size decision unit notifies said 

35 resizing unit of said detected two longitudinal sizes 
and said two lateral sizes, and 

said resizing unit calculates an enlarg- 
ing/shrinking ratio in the lateral directioji on the 

40 basis of said two lateral sizes notified by said 

over-size decision unit and calculates an 
enlarging/shrinking ratio in the longitudinal 
direction on the basis of said two longitudinal 
sizes, and changes the size of the image 

45 obtained by said obtaining unit by enlarg- 

ing/shrinking the image in the lateral direction 
and in the longitudinal direction at the respec- 
tive enlarging/shrinking ratios. 

so 8. The information terminal device according to claim 
5, further comprising a form setting unit (405) oper- 
able to set any of a first resizing form for changing 
the size by enlarging/shrinking the image in the lat- 
eral direction and the longitudinal direction at the 

55 same enlarging/shrinking ratio, a second resizing 
form for changing the size by removing part of the 
image, and a third resizing form for changing the 
size by enlarging/shrinking the image in the lateral 
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direction and the longitudinal direction at separate 
enlarging/shrinking ratios, and 

said resizing unit changes the size of the image 
obtained by said obtaining unit by using the 5 
form set by said form setting unit. 

9. The information terminal device according to claim 
1, wherein said resizing unit changes the size by 
removing part of the image obtained by said obtain- w 
ing unit. 

10. An information terminal device (10) which obtains 
and stores images from a server (18) and displays 
any of the plurality of stored images, comprising: 15 

an obtaining unit (1005) operable to obtain 
from said server said images and a document 
which contains image information associated 
with said images and allowing a user to identify 20 
the images; 

an image accumulative storage unit (1006) 
operable to accumulatively store the images 
obtained by said obtaining unit; 
an image information extracting unit (1009) 25 
operable to extract said image information from 
the document obtained by said obtaining unit; 
a list generating unit (1011) operable to gener- 
ate a list. composed of a plurality of pieces of 
~ said image information extracted by said image 30 
information extracting unit; 
a list display unit (1012 and 1013) operable to 
display the list generated by said list generating 
unit; 

a selecting unit (1014) operable to select a 35 
piece of said image information specified by a 
user from among the plurality of pieces of 
image information contained in the list dis- 
played by said list display in accordance with 
an instruction from the user; and 40 
an image display unit (1016 and 1013) opera- 
ble to obtain the image associated with the 
image information selected by said selecting 
unit from said image accumulative storage unit 
and displaying the image. 45 

11. The information terminal device according to claim 
10, wherein when the image associated with the 
image information selected by said selecting unit is 
absent in said image accumulative storage unit, so 
said image display unit requests said obtaining unit 

to obtain the image from said server. 

12. The information terminal device according to claim 

1 0, wherein said server is a WWW server (1 8) con- 55 
nected to the Internet (17), 

said image information is the storage location 



of said image, and 

the document which contains said image infor- 
mation is an HTML document. 

13. An image resize and display method performed by 
an information terminal device (10) to obtain an 
image from a server (18) and display the image in a 
display area of a screen, said image resize and dis- 
play method comprising: 

an obtaining step (SI 09) of obtaining the image 
from said server; 

an over-size decision step (S113) of deciding 
whether the entirety of the image obtained in 
said obtaining step can be displayed within said 
display area of said screen; and 
a resizing step (S114) of, when said over-size 
decision step makes a negative decision, 
changing the size of the image obtained in said 
obtaining step so that the image can be dis- 
played within said display area of said screen. 

14. The image resize and display method according to 
claim 13, wherein said over-size decision step 
detects the size of the image obtained in said 
obtaining step and compares that size with the size 
of the display area of said screen to decide whether 
the entirety of the image can be displayed within the 
display area of said screen. 

15. The image resize and display method according to 
claim 13, wherein said display area of said screen 
is variable in size, and 

said over-size decision step detects the size of 
the image obtained in said obtaining step and 
the size of said display area of said screen and 
compares the two sizes with each other to 
decide whether the entirety of the image can be 
displayed within said display area of said 
screen. 

16. The image resize and display method according to 
claim 15, wherein said resizing step calculates an 
enlarging/shrinking ratio on the basis of said two 
sizes detected in said over-size decision step and 
changes the size of the image obtained in said 
obtaining step by enlarging/shrinking the image at 
said enlarging/shrinking ratio. 

17. The image resize and display method according to 
claim 13, wherein said display area of said screen 
is variable in size, and 

said over-size decision step detects the lateral 
size and the longitudinal size of the image 
obtained in said obtaining step and the lateral 
size and the longitudinal size of said display 
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area of said screen and compares said two lat- 
eral sizes with each other and said two longitu- 
dinal sizes with each other to decide whether 
the entirety of said image can be displayed 
within said display area of said screen individu- 5 
ally in the lateral direction and in the longitudi- 
nal direction. 

18. The image resize and display method according to 
claim 17, wherein said resizing step calculates an 10 
enlarging/shrinking ratio in the lateral direction on 

the basis of said two lateral sizes detected in said 
over-size decision step and calculates an enlarg- 
ing/shrinking ratio in the longitudinal direction on 
the basis of said two longitudinal sizes, and 15 
changes the size of the image obtained in said 
obtaining step by enlarging/shrinking the image in 
the lateral direction and in the longitudinal direction 
at a smaller one of said two enlarging/shrinking 
ratios. 20 

19. The image resize and display method according to 
claim 17, wherein said resizing step calculates an 
enlarging/shrinking ratio in the lateral direction on 

the basis of said two lateral sizes detected in said 25 
over-size decision step and calculates an enlarg- 
ing/shrinking ratio in the longitudinal direction on 
the basis of said two longitudinal sizes, and 
changes the size of the image obtained in said 
obtaining step by enlarging/shrinking the image in 30 
the lateral direction and in the longitudinal direction 
at the respective enlarging/shrinking ratios. 

20. The image resize and display method according to 
claim 17, further comprising a form setting step 35 
(S106) of setting any of a first resizing form for 
changing the size by enlarging/shrinking the image 

in the lateral direction and the longitudinal direction 
_ at the same enlarging/shrinking ratio, a second 
resizing form for changing the size by removing part 40 
of the image, and a third resizing form for changing 
the size by enlarging/shrinking the image in the lat- 
eral direction and the longitudinal direction at sepa- 
rate enlarging/shrinking ratios, and 

45 

said resizing step changes the size of the 
image obtained in said obtaining step by using 
the form set in said form setting step. 

21. The image resize and display method according to 50 
claim 13, wherein said resizing step changes the 
size by removing part of the image obtained in said 
obtaining step. 

22. An image select and display method performed by 55 
an information terminal device (10) to obtain 
images from a server (18), store the images, and 
select and display any of the plurality of stored 



images, said image select and display method com- 
prising: 

an obtaining step (S206 and S21 9) of obtaining 
from said server said images and a document 
which contains image information associated 
with said images and allowing a user to identify 
the images; 

an image accumulative storage step (S220) of 
accumulatively storing the images obtained in 
said obtaining step; 

an image information extracting step (S210) of 
extracting said image information from the doc- 
ument obtained in said obtaining step; 
a list generating step (S212) of generating a list 
composed of a plurality of pieces of said image 
information extracted in said image information 
extracting step; 

a list display step (S214) of displaying the list 
generated in said list generating step; 
a selecting step (S216) of selecting a piece of 
said image information specified by a user from 
among the plurality of pieces of image informa- 
tion contained in the list displayed in said list 
display step in accordance with an instruction 
from the user; and 

an image display step (S222) of displaying the 
image associated with the image information 
selected in said selecting step among the 
images accumulatively stored in said image 
accumulative storage step. 

23. The image select and display method according to 
claim 22, wherein when the image associated with 
the image information selected in said selecting 
step is absent among the images accumulatively 
stored in said image accumulative storage step, 
said image display step obtains the image from said 
server and displays thejmage. 

24. The image select and display method according to 
claim 22, wherein said server is a WWW server (1 8) 
connected to the Internet (17), 

said image information is the storage location 
of said image, and 

the document which contains said image infor- 
mation is an HTML document 

25. A storage medium which contains a program for 
causing an information terminal device (10) to per- 
form an image resize and display method for 
obtaining an image from a server (18) and display- 
ing the image in a display area (504) of a screen, 
wherein said image resize and display method 
comprises, 

an obtaining step (S109) of obtaining the image 
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from said server; 

an over-size decision step (S113) of deciding 
whether the entirety of the image obtained in 
said obtaining step can be displayed within said 
display area of said screen; and 5 
a resizing step (S114) of, when said over-size 
decision step makes a negative decision, 
changing the size of the image obtained in said 
obtaining step so that the image can be dis- 
played within said display area of said screen. 10 



26. A storage medium which stores a program for caus- 
ing an information terminal device (10) to perform 
an image select and display method for obtaining 
images from a server(1 8), storing the images, and is 
selecting and displaying any of the plurality of 
stored images, wherein said image select and dis- 
play method comprises, 



an obtaining step (S206 and S21 9) of obtaining 20 
from said server said images and a document 
which contains image information associated 
with said images and allowing a user to identify 
the images; 

an image accumulative storage step (S220) of 25 
accumulatively storing the images obtained in 
said obtaining step; 

an image information extracting step (S210) of 
extracting said image information from the doc- 
ument obtained in said obtaining step; 30 
a list generating step (S212) of generating a list 
composed of a plurality of pieces of said image 
information extracted in said image information 
. extracting step; 

. a list display step (S214) of displaying the list 35 
generated in said list generating step; 
a selecting step (S216) of selecting a piece of 
said image information specified by a user from 
among the plurality of pieces of image informa- 
tion contained in the list displayed in said list 40 
display step in accordance with an instruction 
from the user; and 

an image display step (S222) of displaying the 
image associated with the image information 
selected in said selecting step among the 45 
images accumulatively stored in said image 
accumulative storage step. 
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